JOINTLY ORTHOGONAL POLYNOMIALS 

(T) | GIOVANNI FELDER AND THOMAS WILLWACHER 

o 

*vj ■ Abstract. The theory of polynomials orthogonal with respect to one inner 

product is classical. We discuss the extension of this theory to multiple inner 
S ' products. Examples include the Lame and Heine-Stieltjes polynomials. 
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1. Introduction 



-^ Let (,) be an inner product on the space of polynomials M[x\. By the Gram- 

my' Schmidt process we may obtain a basis Eq, E\, . . . of R[x] orthogonal with respect 



to (,). This basis, which we call a Gram-Schmidt basis, has the defining property 
that E n is of degree n and is orthogonal to the space V n -i C R[x] of polynomials 



of degree at most n — 1. In the most relevant cases the inner product has the form 

if, 9) = / f(x)g(x)w(x)dx, 



i 



h> | where I C K is a (possibly unbounded) interval, and w(x) is an integrable almost 

fSJ ■ everywhere positive weight function on I for which all moments exist. 

The classical orthogonal polynomials provide examples of Gram-Schmidt bases, 
which are in addition solutions of a polynomial differential equation Lf = A/. 
Concretely, for a bounded interval I = (— 1, 1) and w(x) = (1 — x)"(l + x)@ one 
obtains the Jacobi polynomials, with Lf = (l — x 2 )f" + (f3 — a — (a + (3 + 2)x)f. For 
a semi-bounded interval / = (0, oo) and w(x) = x a e~ x one obtains the (associated) 
Laguerre polynomials, with Lf = xf" + (a + 1 — x)f . For / = (— oo, oo), w(x) — 
e -x /2 one obtains the Hermite polynomials, with Lf = f" — 2xf. 

In this paper we consider the generalization of the Gram-Schmidt process to 
k > 1 inner products 



(1) (f,9) j = / f(x)g(x)wj(x)dx, 



where j — 1, . . . , k and I\, . . . , Ik C R are disjoint intervals and the Wj are inte- 
grable, almost everywhere positive weight functions, for which all moments exist. 
In this situation it is not immediately obvious how to generalize the defining prop- 
erty E n £ V 7 ^~_ 1 of the Gram-Schmidt basis. It turns out that a good generalization 
is what we call a jointly orthogonal system. To define it let us introduce the fol- 
lowing notation. We denote by V n C M.[x] the space of polynomials of degree at 
most n. Let V k = S' fe IR[a;] be the space of symmetric polynomials in k variables. 
Let V k = S V n C V k be the subspace of polynomials for which the degreee in each 
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variable does not exceed n. For a polynomial p £ l[i] we let 

(2) p (r) :=p® ■■■®p E V r . 

" v ' 

rx 

In particular we set j»'°) := 1 e y° ~ 1. We call symmetric polynomials of the 
form p^ r > rank one tensors. 

Assuming that the intervals I\,...,Ik are ordered from left to right we define an 
inner product (, } on V as follows: 



(3) (f,g) =/•••/ f{xi,...,x k )g(xi,...,x k ) 

J JliX — Xlk 

wi(xi) ■ ■ ■ Wk(xk) J| (xi> - Xi)dx\ ■ ■ ■ dxk- 

l<i<i'<k 

Note in particular that the Vandermondc factor is always positive by the assumption 
on disjointness and orderedness on the intervals. Finally, we define k inner products 
)(!)> •••) ())(fe) 



(>>(!)»• ••>(>}( fe ) on V k 1 such that 



(4) (f,g) U) = /•■•/ f(xi,...,Xj,...,Xk)g(xi,...,Xj,...,Xk) 

wi(xi)---Wj(xj)---Wk(xk) Y\ (xi> - Xi)dxi ■ ■ ■ dxj ■ ■ ■ dxk- 



l<i<i'<k 



where a hat denotes omission. 



Definition 1.1. A jointly orthogonal system of degree n with respect to inner prod- 
ucts (, ) 1 , ...,(, )k (k > 2) as above is a family of polynomials {E a } a of degree n 
in one variable such that the family {E a } a is a basis of V^~ x orthogonal with 
respect to each of the inner products (, )(i), •■■,(, }(k)- 

Note that for k = 2 a jointly orthogonal system of degree n is just a basis of V n 
that is simultaneously orthogonal with respect to the two inner products (, ) l! (, ) 9 . 
Our main result is the following. 

Theorem 1.2. Let (, ) 1 , ...,(, ) k be inner products on R[x] of the form (TTJ) for 
disjoint intervals I\, . . . , Ik ■ Then for every n = 0, 1 , . . . a jointly orthogonal system 
of degree n with respect to these inner products exists, and it is unique up to rescaling 
and permutation of its members. 

The following result relates the notion of joint orthogonality to the Gram- 
Schmidt property. 

Proposition 1.3. A family of polynomials {E a } a is a jointly orthogonal system 
of degree n with respect to inner products (, } 1 , . . . , (, ) fe as above if and only if the 

family of polynomials {Ea '} a forms an orthogonal basis of (V!J*_ 1 )" L C V*, where 
the orthogonal complement is taken with respect to the inner product (, ) as in ([3]). 

In the literature, jointly orthogonal systems arise as solutions to many well stud- 
ied polynomial differential equations. For example, for k = 2 it is well known that 
the Lame polynomials form jointly orthogonal systems. In this case the two in- 
tervals I\,l2 are bounded. The Ince polynomials form jointly orthogonal systems, 
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with one of the intervals being unbounded. The polynomials arising in the dou- 
bly unbounded case have no special name to our knowledge but were studied by 
Turbiner, see also section \2. 31 For k > 2 the known examples are provided by the 
Heine-Stieltjes polynomials or certain higher Heine- Stieltjes polynomials 10 . 

Remark 1.4. Note that the uniqueness part of Theorem 11.21 allows to define each 
of these classical families of polynomials purely in terms of their orthogonality 
properties, without reference to any differential equation. 

Structure of the paper. In sections [2] and [3] we will discuss several classical 
examples of jointly orthogonal systems given by solutions of polynomial differential 
equations. 

In section[4]we discuss some immediate properties of jointly orthogonal systems. 
In particular, we will prove the forward implication of Proposition 11.31 

In section [5] we show that the problem of finding a jointly orthogonal system 
can be restated as a multiparameter eigenvalue problem. Its solutions exist and are 
unique, hence Theorem 11.21 follows. 

Finally section [6] discusses our version of the Gram-Schmidt algorithm, which 
we call the rank 1 Gram-Schmidt algorithm. A uniqueness result therein will show 
the reverse implication of Proposition 1 1.31 

For most of the proofs it will be convenient to work in a slightly more gen- 
eral setting than discussed in the introduction. Essentially, we allow general inner 
products, replacing the condition of disjointness of the intervals by a more abstract 
definiteness condition. The relevant definitions can be found in section 14.11 
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2. Examples: Jointly orthogonal polynomials for two inner products 

Let us consider the case of two inner products, i.e., k = 2. A jointly orthogonal 
system of degree n is just a basis of V n simultaneously othogonal with respect to 
both inner products. 

2.1. Heun and Lame polynomials. Let Q(x) = (x — ei)(x — eo)(x — 63), be a 
monic polynomial of degree 3 with distinct real roots e\ < e 2 < e 3 and P(x) a 
polynomial of degree 2 such that aj := P{e.i)/Q'{e-i) > 0. Set 

3 
wi(x) = w 2 (x) = w(x) = Y[ \x-e i \ ai ~ 1 , ii = (ei,e 2 ), h = (e 2 ,e3). 

i=l 

The Heun differential operator, cf. [3], 

— P(x) — 
dx 2 dx 



L„ = Q(x)^-$ + P(x) — - n(n - 1 + a\ + a 2 + a 3 )x 



= Q( x ) To + ^ — " r~ _ n ( n - 1 + «i + «2 + a 3 )x 

\ dx i r^t x — e, dx J 

preserves V n and is self-adjoint with respect to both inner products. The latter 
property follows by integration by parts by using the relation 

«/(£) P{x) - Q'{x) 

[ ' w(x) Q(x) 
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Indeed this identity implies that 

,.6 ,-b 

L n f(x)g(x) dx = J f(x)L n g(x)dx + (f'g - fg')Qw\ b a 

and since 

(6) lim Q(x)w(x) — 0, for all endpoints xq of the intervals h,l2, 

L n is selfadjoint for both inner products. Thus the jointly orthogonal polynomials 
E a ,m ol — 1, . . .,n + 1, of degree n are the polynomial eigenvectors of the Hcun 
differential operators. 

Lame polynomials arise in the special cases where a^ € {1/2, 3/2}. By definition 
they are solutions of the Lame differential equation 

Q{x)y"{x) + ~Q'(x)y - i(i/(i/ + l)x + X)y = 0, 
with Q as above, of the form 

(7) y{x) = f[(x - e^pix) 

with p(x) a polynomial and €, £ {0, 1}. If e\ = e 2 = 63 = the Lame equation is 
the eigenvalue problem for the Heun operator L n with parameters n — v/2, Oj = o> 

i = 1,2,3. The other cases can be related to this case: let e 6 {0,1} 3 and L„ 
denote the Heun operator with parameters n, Oj = \+^i- Then we have the identity 

f[(x - «)-* o L V») o f[( x - etyl* = L^_ i(i+e2+e3)/2 + c, 

1=1 8=1 

for some multiple of the identity c. 

Solutions of the Lame equation of the form (J7J with 1 + ei + £2 + £3 = & are 
called Lame polynomials of degree v of the fc-th species. The parameter v dictates 
the behaviour at infinity of solutions and so the degree n of p: 

v = 2n + €1 + e 2 + 63. 

Let Ea,n, ol = 1, . . . , n + 1 be the jointly orthogonal polynomials of degree n with 
parameters a, = e, + 1/2. Then for even v = 2m > 0, there are Lame polynomials 
of the first species Ea, m , a = 1, . . . , m + 1, and of the third species 

(x-e 1 ) 1 Hx-e 2 )^E^l l , (x - ei )i(x - e 3 )i E^_ x , (x -e 2 )i(z- e 3 M°"-i> 

a = 1 1 . . . ,m. For odd ^ = 2m + 1 > 0, there are Lame polynomials of the fourth 
species 

(x - ei) ^ (aj - e 2 ) » (a; - e 3 ) 2 £«, m li, 

and of the second species 

(*-ei)*££°?, (x-ei)*^), (s-ei)*^. 

In both cases there is a total of 2zv + 1 Lame polynomials of degree v. 

The Hcun differential equation L n y = Ay is a Fuchsian differential equation with 
four singular points (ei, 62, e3, 00) on the Riemann spheres. The next examples are 
confluent versions where singular points merge at infinity. 
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2.2. Whittaker Hill equation and Ince polynomials. Let a < 0, a > 0, 

w(x)=e 2ax \l-x\ a i- 1 \l + x\ a *- 1 , Ji = (-1,1), J 2 = (l,oo) 

For <n = |, §, the jointly orthogonal polynomials are related to solutions of the 
Whittaker-Hill equation, see [l5l 151 [T3l [2l fe] , 

-ip"(e) - (Acos(26>) + Bcos(4d))ip(e) = \ip(0) 

in trigonometric polynomials. Let us explain the relation. The differential operator 

d 2 d 

L n = (x 2 - 1)— ^- + (ai(a; + l) + a2(.T-l) + 2a(.T 2 - 1))- 2nax 

dx z dx 

clearly preserves the space of polynomials of degree < n. It is self-adjoint for both 

inner products as its coefficients Q(x) = x 2 — 1 and P(x) = a\(x + 1) + 02(2; — 

1) + 2a(x 2 — 1) obey the relations ([5]), ((6|). The change of variables x — cos(29) 

transforms L n to the differential operator 

l - = -\W + (-"^^ + £1± F i »t(2 S ) + «-* ) I - 2„ac„ 8 (20). 

Let a±, a,2 6 {^, § } and set q = a^ — | G {0, 1}. Let 

<p(0) = sin(6») £l cos(0) £2 e acos(29) . 

Then i7„ = cp o 4L n o (p^ 1 = il„ + c is the Whittaker-Hill differential operator 

d 2 
ff^ = — — - 4m/cos(20) - 2a 2 cos(4(9), 

with parameter v = 2ra+l+ei+e2, up to an additive constant c = 2a 2 +4(e2 — ei)a— 
(d + £2) 2 - It follows that the jointly orthogonal polynomials E^^ 3 ', . . . , E^l^' n for 
ai = £i+ 2 1( ={2"'2J' yi e ld eigenfunctions of ff y of the form 
(8) ^£ £1£2) (#) = sin(0) ei cos(6y 2 Ei^(cos{28))e acos( - 2e \ v = 2n + 1 + ei + e 2 . 

Altogether we get for each positive integer ^ a basis of the space of eigenfunctions 
of H u of the form 

p(0)e acos(2e \ pe rP„_ 1 =R[cos(9),sin(e)]< v _ 1) 

the space of trigonometric polynomials of degree < v — 1. If zv is even, the trigono- 
metric polynomials are 

sin(0)^ ) /2 _ 1 (cos(20)), co S (9)^ 2 _ 1 (cos(2^)), a = 1,.. .,i//2, 

and they form a basis of the subspace of TP v -\ of 7r-antiperiodic polynomials, i.e., 
obeying p(0 + 7r) = — p(6). If f is odd they are 

E Ti-i)/2^ < 2e ))^ « = !,.••> + 1)A 

sin(0) cos(0)i^_ 3)/2 (cos(2#)), a = 1, . . . , (1/ - l)/2, 

and they are a basis of the subspace of 7r-periodic polynomials in TP v +\. The 
trigonometric polynomials arising this way are called Ince polynomials. They are 
a solutions of the differential equation 

p" + Aasm(20)p' + (4(f - l)acos(20) + X)p = 

for different values of the spectral parameter A. 
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2.3. Eigenfunctions of Schrodinger operators with sextic potential. Let 
£>-l, 

w(x) = \x\ e+1/2 e- x2/2 dx, h = (-00, 0), I 2 = (0, oo). 
The differential operator 

L = -2.x-—- + (2.x 2 - 2£- 3)- 2nx 

dx z ax 

preserves polynomials of degree < n and is self-adjoint for both inner products, 
since its coefficients Q(x) = —2x and P(x) = 2x 2 — 21 — 3 obey ([5]) and ^. After 
the change of variables x — r 2 , L becomes 

L--~— (r 3 £+1 \ d n nr 2 
2 dr 2 \ r J dr 

This operator is related by conjugation by 



ip(r) 



- r (+1 P - r / 4 



r e 



to the radial Schrodinger operator with sextic potential 



H = —if o 2L o (p 



d 2 , 6 2 , ^+1) 



r — vr 



dr 2 

with v — An + 5 + 2£, introduced by Turbiner |12) in his theory of quasi-exactly 
solvable systems and is a special case of the family of monodromy free Schrodinger 
operators with sextic growth [5] . It follows that the simultaneous orthogonal poly- 
nomials Ei, ... , E n+ i give a basis 

^(r)=^ +1 e-'' 4 / 4 £ Q (r 2 ) 

of eigenfunctions of H in 

W n = {/+ 1 e-'' 4 / 4 p(r 2 ), p e V n }. 

The simultaneous orthogonality translates to the condition that these eigenfunc- 
tions are characterized as being jointly orthogonal for the two inner products on 



f(r)g(r)dr, e ~^(^) f f L™/ 2 r\ g (W 2 r) 



dr. 



3. Examples for higher k: Heine-Stieltjes polynomials 
Consider the differential equation 



(9) f[(x - e{)y" + J2 m 3 f[(x - e^y' + V(x)y = 0. 

j=0 j=0 i=0 

Here the unknowns are y and the degree k — 1 polynomial V(x) (the van Vleck 
polynomial), which generalizes the eigenvalue A in the previous examples. The 
Heine-Stieltjes polynomials are the polynomial solutions y of the above equation. 
For each van Vleck polynomial V there is at most one polynomial solution y. Fur- 
thermore note that for Heine-Stieltjes polynomials of degree n the leading coefficient 
of the van Vleck polynomial must necessarily be — n(n —1 + ^ rrij) We assume in 



JOINTLY ORTHOGONAL POLYNOMIALS 7 

the following that the roots a are real and ordered, eo < ei < • • • < ek, and that 
too, . . . , TOfe > 0. The differential operator 

k j2 ^ k , 

L = H(x - e 4 )-^2 + Y, m i II^ - e ^Yx 
i=a j=o i=a 

is self-adjoint with respect to the k inner products 

(f,g)j= f{x)g{x)w(x)dx 

Je j _ 1 

where 



\x-e,n~\ 



w(x)=n\ 

4=0 

There is a well-known orthogonality relation satisfied by Heine-Stieltjcs polynomi- 
als, found by Gcrmanski [4] and rediscovered by Volkmer [14] : 

(10) (e^,e^)=o 

where E ai Ep are two distinct (i.e., non-proportional) Heine-Stieltjes polynomials 
and the inner product is the inner product §5§ ony fc . To see (ITU1) . note that 

(E a , (V a - Vp)E fi ) j = {E cn LEp) j - {LE a ,E p ) j = 

where V a , V@ are the (necessarily distinct) van Vleck polynomials corresponding to 
E a , Ep . It follows that the matrix 

(E ai Ef;) 1 ■■■ (E a ,Ep) 

y (E a ,x k ~ 1 E p ) 1 ■•• (E a ,x k - 1 E ) k/ 

annihilates the coefficient vector of V a —Vp. Hence the determinant of the above 
matrix is zero. This is easily calculated to be the statement (TTU1) . 

Note furthermore that if E a , Ep are both of degree n, then V a — Vp is of degree 
< k — 1 since the leading coefficients of the van Vleck polynomials are necessarily 
the same. Hence the matrix 

{E a ,Ep} 1 ■■■ (E a ,Ep) k 

y (E a ,x k ~ 2 Ep) 1 ■•• (E a ,x k - 2 Ep) k/ 

must be rank deficient and hence all its k minors vanish. The vanishing of the j'-th 
minor is easily checked to be equivalent to the condition 

where (, ), n is the scalar product ^ on V k ~ 1 . 

It is furthermore well known that the Heine-Stieltjes differential equation has 
N = ( n t_7 ) polynomial solutions of degree n, in one-to-one correspondence with 
the N ways of distributing the n roots of y among the k intervals (ej_i, ej) [TT]. It 
follows that the Heine-Stieltjes polynomials of degree n form a jointly orthogonal 
system of degree n according to Definition 11.11 
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4. Jointly orthogonal systems 

4.1. Definitions. As in the introduction we denote the space of symmetric poly- 
nomials in k variables by V k and let V k C V k be the space of symmetric polyno- 
mials of degree at most n in any variable. For example x\x\ + x\x\ £ V$, while 
x\x 2 + x\x\ g V 2 . 

Suppose we are given k inner products (, ) x , ...,(, ) k on the space of polynomials 
M\x\. We suppose throughout this paper and without further mention the following 
condition: 

Standing Assumption: The operator of multiplication by x is self-adjoint for 
all scalar products on M.[x) considered. 

The k inner products on M.[x] can be used to define an symmetric bilinear form 
(, } on V k such that 



(11) (p<*W*>\ = det 



\(p,x k - 1 q) 1 ■■■ (p,x k - 1 q)J 



for all p, q £ M[x], where we used again the notation ([2|). Depending on the inner 
products (,},-, this bilinear form may or not be definite. We will generally assume 
the following condition. 

Definiteness Condition 1: For all non-zero p G R[x]: (p^'jP^) =^ 0. 

Remark 4.1. Note that by renumbering the scalar products (, } we may change 
the sign of (, ), so we might as well ask that (p( k ',p( k ') > in the above condition. 

Similarly, we define k symmetric bilinear forms (, )n\, ■ ■ ■ , (, }(m on V k ~ 1 such 
that 



(12) (p (fe - 1) , 9 (fe - 1) ) 



U) 
I (p,Q)i •■• (P,<l)j-i (P'Q)j+i •■• (Pj9>* 

det 

\(p,x k - 2 q) 1 ••• (p,x k - 2 q)._ 1 (p,x k - 2 q) j + 1 ■■■ (p,x k - 2 q) k 

for all p,q £ M.[x]. These bilinear forms again may or may not be definite. However, 
for some results below we will assume the following condition: 

Definiteness Condition 2: For all non-zero p £ R[x) and all j = l,...,k: 
(p(*-i),p(*-D)^0. 

Assuming that Definiteness Conditions 1 and 2 are satisfied, we extend Definition 
II .11 of jointly orthogonal systems verbatim to this more general setting. 



Example 4.2. Scalar products (, ) as in (jTJ) for disjoint intervals I\, . . . , Ik satisfy 
the Definiteness Conditions 1 and 2. To see this, note that the bilinear form (fTTj) 
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takes on the form 



k 

(13) (/,/)=/•••/ \f(xi,.-.,x k )\ 2 J| (xi-Xj) Y[wj{xj)dXj 

"* l<i<j<k j=l 

where / £ M[xi, . . . ,Xk], using the Vandermonde formula. Since the intervals are 
disjoint, the Vandermonde factor is non-zero and has a definite sign, while all other 
terms are non-negative. Hence Definiteness Condition 1 holds. By an analogous 
argument, Definiteness Condition 2 also holds. 

4.2. Properties. 

Lemma 4.3. Let {E a } a be a jointly orthogonal system of degree n with respect 
to the inner products (, ) 1 , ...,(, ) fe . Then the symmetric polynomials E a are 
orthogonal (with respect to the bilinear form (|11[) ) to all symmetric polynomials 
Q€V*_ t cVl 

Proof. Note that for any polynomial p of degree at most n and for all i,j 6 
{l,...,fc}, 



/^(k- 1 ) _(fc-i)\ /p( fe_1 ) ~(fc-i)\ 

P ( A ° >P { J /W p(fe-l) _ n (A,-l) _ V^ *> a lP ' U) F( fe -!) 

-^ /p(fc-i) p (fc-i)\ p 2-~> /p(fc-i) p (fc-i)\ a 

a K&a ,-C/q )(i) a \^a , &a ) (j) 



Hence 



(14) 



(-fro ,Xi Q /(j) ^ii Q ,£/ Q /(j) 



for any polynomial p of degree < n and any a. 

Our goal is to show that for any Q £ V^_ 1 and any a 

(E a ,Q) = 0. 

Since the rank one tensors span V„_ 1 it suffices to show the above equation for Q of 
the form q^ k ' , where q is a polynomial of degree at most n — 1. We will distinguish 
two cases: 

(i) Suppose (Si' c_1) , g ( fe - 1 )) (1) = 0. Then by CLl, (E^'^, q {k ~ l) ) {i) = for all 
i. Hence 



<£i fe W fe >) = ^lr+^^-M^^w^w = o, 



expanding the determinant (fTTj) with respect to the last row. 

(ii) Suppose (Ea ><r* _1 ^)(i) 7^ 0. Expand the determinant (fTTj) with respect 
to the first row and compute 
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(Ei k \ q ^) = j2(-iy +1 (E a , q )M k - 1 \(x<i) {k - 1) )( t ) 

i=l 

= E(- 1 ) i+1 ^^M^^(^) (fc - 1) )(i) S fc -i)'^-i) W 

(Eg 7 (xq) (k -^) {1) ^ , W/ , /p(fe-i) p(fc-l)\ 

- /J7 (k-1) „(fc-l) N 2J _1 ) { E <x,<lH( E a ', E 'a ')(€) 

\Ea f&a )(i) j=i 

/ T-l(fc— 1) / \(fc— 1)\ ^ 

- ,„(*-!) o(fe _ 1)v ZJ" 1 ) (^M^ W ')(0 

\ ft a )? v V(l) i=l 

= 0. 

Here we used Q3]) twice, once for for p = xq (this is possible since q is of degree 
< n — 1) and once for p = q. The last equality is true since the left hand side is a 
determinant of a matrix with two equal rows. □ 

An important feature of a jointly orthogonal system E a is that it defines a family 
of orthogonal symmetric polynomials in V k . 



Lemma 4.4. Let {E a } a be a family of polynomials such that the Ea form a 



jointly orthogonal basis of V k 1 for the inner products (,)(<), i = l,...,fc. Then 



the vectors 

E^ e V k 

are pairwise orthogonal with respect to ([lljl . 

Proof. As in [H [T3] define, for each fixed pair a ^ (3, the k x k matrices 

M a ^ = ({x i - l E a ,E^ j ) ij , 

(k) 

Orthogonality of the E a ' is the statement that 

detM a p = (E£\Ef)=0. 

Let M 3 a a be the minor obtained by deleting the fc-th row and the j-th column. Joint 
orthogonality is the statement that 



dctMi^(Ei k ^,Ef- 1) ) (j) =0 



for j = 1, 2, . . . , k. Clearly, by expanding det M a p along the fc-th row the statement 
of the Lemma follows. □ 

Remark 4.5. Note that if we are given jointly orthogonal systems for each degree 

(k) 

n = 0, 1, . . . , the symmetric polynomials E a form an orthogonal basis of the space 
of symmetric polynomials V . By Theorem lf .21 this basis is canonical, i.e., uniquely 
defined (up to rescaling) and independent of arbitrary choices. This is in contrast 
to other methods of obtaining an orthogonal basis of V k , for example by applying 
the Gram-Schmidt algorithm to an arbitrary non-orthogonal basis. 
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5. Joint orthogonality and multiparameter eigenvalue problems 

5.1. Symmetric rectangular multiparameter eigenvalue problems. 

Let A±, . . . , Ak be complex (m + fc — 2) x m matrices. A rectangular multiparameter 
eigenvalue problem is the equation 

k 

(15) Yl XiAiV = ° 

i=l 

in complex unknowns (Ai, . . . , A&) 7^ (the multiparameter eigenvalue, defined up 

to a multiplicative constant) and ^ v € C™ (the eigenvector). Eqn. (IT5J) is 

overdetermined and may have solutions or not. 

Define the m x m matrix Ay, 1 < i < fc, 1 < J < fe — 1, as the submatrix of 

Ai composed of the rows j, . . . , j + m — 1. We call the rectangular multiparameter 

eigenvalue problem symmetric if all matrices Ay are real and symmetric. 

Remark 5.1. For fc > 2 the matrices Aj appearing in a symmetric rectangular 
multiparameter eigenvalue problem are necessarily Hankel matrices. 

Similar to (|12l) define the fc-vector valued sesquilinear form /j, on S* -1 C™ such 
that 

(J,(u ® ■ • • ® u, V ® • • • ® v) := det(u T Ajjt))jj. 



• • • r 1 .= (lci W" 
fe— lx fe— lx 



Here the vector valued determinant det of a (fc — 1) x fc matrix is the fc-vector 
of its minors of size fc — 1, taken with alternating signs. If for all non-zero v 6 
C": /i(v® fe-1 ,u® fe-1 ) =^ one calls the mutiparameter eigenvalue problem locally 
definite. 

In the following, we will say that two multiparameter eigenvalues are distinct if 
they are not collinear. We will say that a multiparameter eigenvalue is real if some 
non-zero multiple is real. 

Proposition 5.2. Suppose v is an eigenvector of a symmetric and locally defi- 
nite rectangular multiparameter eigenvalue problem. Then the corresponding mul- 
tiparameter eigenvalue is X = /j,(v^ k ~ 1 ,v^ k ~ 1 ) and is real. Suppose u is another 
eigenvector corresponding to the eigenvalue A' which is distinct from A. Then 

v{u® k -\v® k - 1 )=Q 

In addition all multiparameter eigenvectors may be taken real. 

Proof. It is an easy verification, using Cramer's rule. □ 

For fc = 2 and A\ the identity matrix, the proposition reduces to well known 
statements of elementary linear algebra. 

Remark 5.3. We use here the notation "rectangular multiparameter eigenvalue 
problem" to distinguish it from a multiparameter eigenvalue problem in the sense 
of |14j . A rectangular multiparameter eigenvalue problem determines a multipa- 
rameter eigenvalue problem in the sense of loc. cit., and eigenvalues in our sense 
are eigenvalues in the sense of loc. cit. Since we only consider multiparameter 
eigenvalue problems that are rectangular in this paper, we will sometimes drop the 
adjective rectangular, abusing notation slightly. 

Remark 5.4. A more general definition of symmetry of a rectangular multiparam- 
eter eigenvalue problem is provided in Appendix [Cj 
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5.2. The relation to joint orthogonality. One motivation for Definition 11.11 is 
the following Theorem. 

Theorem 5.5. Assume inner products (, ) 1 , . . . (, ) fe on l[i] are given that satisfy 
the Definiteness Conditions 1 and 2. Then the following two conditions are equiv- 
alent for a family {E a } a= i n of degree < n polynomials, with N = ( n J,J^ ) = 

dimV^- 1 . 

• {E a } a is a jointly orthogonal system of degree n with respect to the inner 
products given. 

• The E a are solutions to the symmetric rectangular multiparameter eigen- 
value problem 

k 

(16) Yl \ E «h A «J = ° 

for distinct non-zero eigenvectors X a — {X a ,i, • ■ • , A a ,fc), where \E a ) ■ is the 
linear form v i— ^ (v, E a ) ■ on the space of polynomials of degree < n + k — 2. 

In fact, all such \ a are multiples of 
(17) 

Remark 5.6. In the usual monomial basis of the space of polynomials p^|) becomes 
a symmetric multiparameter eigenvalue problem of the form (|15[) . Here m = n + 1 
and Aj is the matrix of the linear operator 

V n — > V n+k _ 2 
sending v € V n to \v) j e V* +k _ 2 . 

Corollary 5.7. The Heine- Stieltjes polynomials are solutions to the rectangular 
multiparameter eigenvalue problem above for distinct eigenvalues. 

Proof of the Theorem. Suppose first that the E a solve the eigenvalue problem with 
respect to distinct eigenvalues. Then by Proposition 15.21 the eigenvalues are ob- 
tained by (Tl7|) and the Ea form an orthogonal basis of V^~ x with respect to 
each of the bilinear forms (, )/••>. 

For the other direction, note that for all p 6 V n 

0-E(-iy- 1 <P,£a> i (p (fc - 1) ,S(*- 1 )) 



pCfc-i), £;(,*-!) \ k 



(i) 



^(-ly-^.^/sCfc-D.BCfc-i) 



( fc -i) ( h _i)\ ^ > -' -n ° '-<• /(i) 



/(I) 

The first equation is the vanishing of a determinant with two equal rows, and for 
the second equation we used (|14| . Note that the right hand side is a product of 
a polynomial in (the coefficients of) p and a linear function in p. If the product 
vanishes for all p, then one of the factors has to vanish identically. It can not be 



£( 
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the first, since this factor is 1 for p = E a . Hence 

j^{-iy-\p,E a ) 3 {E^- l \E^ 1] ) =0 

3=1 W 

for all polynomials p of degree at most n. Hence the left hand side of (fTl))) is zero on 
all polynomials of degree < n. Next, evaluate the left hand side of (|16l) on X r E a , 
r = 0,...,k-2. 

k 

yiy-'iE^x^^^Ei^KEi^) 

This is however the determinant of a matrix with two equal rows and hence zero. 
Summarizing, we have shown that the left hand side of (|16|) vanishes on all polyno- 
mials of degrees < n + k — 2. Hence the E a are indeed multiparameter eigenvectors. 
It remains to be shown that the corresponding eigenvalues are distinct. So suppose 
to the contrary that two members of the family both are eigenvectors for some 
eigenvalue (Ai, . . . , Afe). Since the members of the family are non-collinear by as- 
sumption, the kernel of X)i=i A? Aj nas dimension > 2. It follows that there is 
polynomial of degree < n in the kernel, say v. But then we may replace 

k Xk 

in the determinant defining /t™,!!"), see (|11[) . The determinant of a matrix 
with linearly dependent columns vanishes, and hence arrive at a contradiction to 
Definiteness Condition 1. Here we used that Ai ^ 0, which follows from (fl7|) and 
Definitencss Condition 2. Alternatively, since A ^ we may as well suppose that 
Ai ^ 0. □ 

5.3. Existence of solutions, and the proof of Theorem 11.21 

Theorem 5.8. Assume we are given k inner products on the space of polynomials 
such that Definiteness Conditions 1 and 2 hold. Then for every n the eigenvalue 
problem (|16|) has ( n T_7 ) distinct solutions (Ai,...,Afc) £ P fc_1 . In particular 
it follows that there is a (unique up to reseating) set of ( n T_7 ) "multiparameter 
eigenvectors E a that form a jointly orthogonal basis in the sense of Definition \l.f\ 

Proof. First let us show that there are N := (™^"^ 1 ) solutions, counted with mul- 
tiplicity. For this we can use Shapiro's lemma, see Appendix |A"1 Indeed, note that 
by the Definiteness Condition 2, there can be no eigenvalue A = (Ai, . . . , Afe) which 
has a zero component, and in particular none that has Ai = 0. It follows that 
X2A2 + • ■ • + Afe Afe is rank deficient iff all A2 = A3 = • • ■ = Afe = 0. Hence the 
condition in Shapiro's Lemma is satisfied. Hence there are N solutions counted 
with multiplicity. It remains to show that there are no solutions of multiplicity 
> 1. 

First note that the kernel of J2j=i A? Aj cannot have dimension > 2. Otherwise, 
we can arrive at contradiction to Definiteness Condition 1 as in the proof of Theorem 
IS31 

It remains to be shown that if A is an eigenvalue of multiplicity > 2, then the 
corresponding eigenspace is of dimension > 2. The set of A,'s for which there are 
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multiple eigenvalues is Zariski closed, and there is a point in the complement by 
Corollary I5.7[ or alternatively by the explicit computation of Appendix [5] Hence 
we may always perturb the eigenvalue problem so as to lift the degeneracies of 
eigenvalues, so say we set A e - — Aj + eBj. Then there are eigenvectors v e ,w e to 
the distinct perturbed eigenvalues, continuously depending on e > 0, such that 
Ve j We are orthogonal. To disregard the arbitrary multiplicative factor, we also 
consider the corresponding one-dimensional eigenspaces V e ,W e G P™ _1 , which are 
uniquely defined. By compactness, they have to have limit points (as e — > 0), 
and there must be at least two different limit points by orthogonality of V £ , W € . 
Suppose v,w 7^ are vectors in these limit points (subspaces). Then by continuity 
^2- AjA^ must annihilate both v and w at e = 0. Hence the kernel is at least 
2-dimensional. □ 



6. Orthogonal symmetric polynomials and the rank 1 Gram-Schmidt 

algorithm 

In this section we show that the two conditions of Definition 11.11 arc slightly 
stronger than necessary to guarantee uniqueness. 

Proposition 6.1. Assume an inner product on the space of symmetric polynomials 
V is given. Suppose we are given two families of polynomials {E a } a , {E' a } a with 
E a ,E' a G V n , such that the families {E& } a and {(E' a p k '} a both form bases of 
(Vn_i) C V r k . Then the two families are identical, up to rescaling and permutation 
of its members. 

The proof will be given in the subsequent section. 

Remark 6.2. It follows that the rank 1 basis of (V^_i) in this case is essentially 
the set of rank one, norm one tensors in (V^Li) . "Essentially" here means that if 
v is of rank one and norm one, so is — v of course, so we must pick one of v or —v 
for the basis. 

In particular, the jointly orthogonal system in the sense of Definition 11.11 is 
essentially the set of polynomials v G V n such that v^ r ' € (V k _ 1 ) ± . 

The following algorithm can hence be used to determine the (essentially unique) 
jointly orthogonal systems of each degree. 

Rank 1 Gram-Schmidt Algorithm: 

(1) Initialization: A jointly orthogonal system of degree is given by the con- 
stant polynomial Eqi := 1 G Vq. Set n = 1. 

(2) Solve the system of homogeneous polynomial equations 

« W ,B« 1<a )=0 

for v G V n where a = 1, 2, ... , (™£_^ 2 ). Assuming that the inner product 
is of the form (fTTj) and assuming Definiteness Conditions 1 and 2 one finds 
( n J._i ) solutions up to rescaling. They become the jointly orthogonal 
system {E n ^ a } a of degree n. 

(3) Increase n and go to step 2. 
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6.1. Proof of Proposition [6. 11 

Remark 6.3. Note that a (non-orthogonal) basis of V* may be given by the 
monomial symmetric polynomials m^ where /i = (/ii, . . . , /ifc), n > /Ui > \xi > • • • > 

/ifc > is a multiindex. Counting such multiindices, one sees that 



dimV n * 
It follows that 



n + k 
k 



v nrk \_l fn + k\ fn + k — l\ fn + k — l\ ,. jr k-i 
<hm(Vi_ 1 ) ± ={ k )-[ k ) = [ k _ 1 )=dnnV^ \ 

Explicitly, a map V^ 1 — > {V*^) 1 - may be defined as the composition V k ~ x 
Vn ~ *■ (Kf-i) 1 " where the first arrow sends 



and the second is the orthogonal projection. An explicit isomorphism in the other 

dxV 



direction (V^^) 1 - — )• V£ 1 is given by the operator -§-k. In particular, the images 



of the elements E a of a rank one basis under this operator are non-zero multiples 
of 

Ei k - 1] =E a {xi)E a {x2)---E a {x k -x). 

Hence it follows that the Ea ~ form a basis of V^~ x . 

Proof of Provosition \6. 11 Suppose there is some degree n polynomial p £ C[x] such 
that p^ := p(xi) ■ ■ -p(xk) is in {V^^ 1 -. We want to show that p^ is a multiple 
of some Ea . Since the E a form a basis, we may write 



P «=5>4 fc) 



for some constants A Q . Let oi, . . . , a r be the roots of p, with multiplicities mi, . . . , m r . 
Let ev Xk=a be the operator of evaluation at x^ = a and apply the operators 

&> 

eVxk=a '~dJ k 

on both sides of the above equation for i = 1, 2, . . . , r, j = 0, 1, ... , rn r . — 1. Wc 
obtain n equations of the form 

Q = Y,^c ai jE a k - l \ 

a 

for some constants c a ij which are zero iff E a has a root c^ with multiplicity not 

. . (k— 1) 

equal to j. Since by Remark l6.3l above the E a are elements of a basis and hence 
linearly independent, we must have X a c a ij = for each a,i,j. Hence X a = unless 
E a has the same roots, with the same multiplicities, as p. But then p oc E a - D 



Note that by Theorem 11.21 the Rank 1 Gram-Schmidt algorithm will succeed 
in finding the jointly orthogonal systems if the inner product on V k has the form 
(fTTj) and Definiteness Conditions 1 and 2 are satisfied. For a general inner product 
however, the algorithm might fail, as the following example shows. 
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Example 6.4. For a general inner product on V k a rank 1 basis may or may not 
exist. As an example, consider the n = 1, k — 2 case. Polynomials in this case may 
be identified with 2x2 symmetric matrices. Fix a basis e± = X1X2, e 2 = X\ + X%, 
e 3 = 1. Consider the inner product 



(ei, ei) = (e 3 , e 3 ) = 1 (e 2 , e 2 ) = A 

(ei, e 2 ) = (e 2 , e 3 ) = (ei, e 3 ) = -e 2 



where A>0, < e < 1. The rank 1 vectors in the orthogonal complement of e 3 
are e\ ± ee 2 + e 2 e 3 . So in particular, there may be either 2 or only one, depending 
on e. Furthermore, these two vectors are orthogonal iff 



e 4 - Ae 2 



so while generically the vectors are not orthogonal, for a specific value of A they 
are. 

6.2. Proof of Proposition 11.31 The forward implication of Proposition [O] is the 
content of Lemmas 14.31 and 14.41 of section 14.21 

For the reverse implication note that the by Proposition 16.11 the condition of 
Proposition 11.31 determines the family {E a } a uniquely up to rescaling and permu- 
tation, if such a family exists. However, by Theorem ll.2l and the forward implication 
we know that at least one such family exists, namely a jointly orthogonal system. 
Hence, by uniqueness, the family {E a } a must be a jointly orthogonal system. □ 



Appendix A. Shapiro's Lemma 

Let V be the variety of rank deficient n x m matrices (n > m) . It has been shown 
in pQ that the degree of the variety V is ( m ™ x )- 

Lemma A.l (Shapiro [El)- Let A,Ai,..., A n _ m _i be n x m matrices such that 
the subspace W spanned by A\, . . . , A n _ m _i intersects V only at zero. Then the 
variety A + W intersects V at exactly ( n _ A points, counted with multiplicity. 

Proof. First, intersections at the infinite plane correspond to rank deficient linear 
combinations of A\, . . . , A n _ m _i. Hence by assumptions, there are no intersection 
loci on the infinite plane. Hence there can be no intersection loci of dimension > 1 , 
since they would automatically contain infinite points. Hence all intersection loci 
are points. Bezout's Theorem then says that there are ( ™ ,) points, counted with 
multiplicity. □ 
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Appendix B. An example multiparameter eigenvalue problem 
Let us consider the following multiparameter eigenvalue problem: 

\ 



Ai 








A 2 


Ai 





A 3 


A 2 


Ai 


A 4 


A 3 


A 2 



(18) 









A ^ 






























v = 



... A* X k -i Xk-2 
\0 ... X k A fe _i7 

where, as before, A = (Ai, . . . , Afe) is the multiparameter eigenvalue and v is an n+1- 
vector, the multiparameter eigenvector. The eigenvalue problem is not symmetric 
as it stands, but may be put into symmetric form by reversing the order of the 
columns of the above matrix. The dcfiniteness condition does not hold in this case 
in general. 

We will show that the eigenvalue problem has a complete set of solutions, so 
there are (" ) distinct eigenvalues, where we set k := k — 1. They are given by 
the following construction: 

(1) Pick k distinct (n + K)-th roots of unity, call them £i, . . . , £ re . There are 
clearly (™^ K ) choices, each of which will give us one eigenvalue and one 
eigenvector. 

(2) Set Xj to be the coefficient of i""- 1 in the polynomial nr=i( x ~~ 0)- This 
defines the multiparameter eigenvalue. Clearly, different choices of Q's yield 
distinct eigenvalues. 

(3) Let v = (vq, . . . ,v n ). Then we set 



/ 



det 



1 

Ci 






i 



^2 

^2 



1 

7k- 1 

/■J+l 



\ 



We may expand along the last row to write this alternatively as 

(19) ^ = E^ +1 



where the pi are the appropriate minors. They are Vandermonde determi- 
nants and independent of j. 



Lemma B.l. The above X, v solve the eigenvalue problem (|18[) . 
Proof. Componentwise, the eigenvalue problem are the equations 



(20) 



k 



iVj+i- 



= 
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for j = 0, 1, . . . , n + K — 1, where we set 

(21) «_! = ••• = V- K+ i = v n+1 = ■■■ = v n+K -i = u_ K = v n . 

We call these latter equations the boundary conditions. 

It is well known that the Ansatz (fT9| (for arbitrary pi) solves the recursion (f20|) . 
if the Ci are the roots of the characteristic polynomial 

I>rv. 

In our case they are by definition of A. However, we need to verify that the bound- 
ary conditions (f2~Tj) are also respected by the Ansatz ([T9|) . For the first set of 
equations in (fT!?)) note that £? = Cj J_ i an< ^ hence the determinant vanishes for 
j = — 1, .... — k + 1. Similarly, since the Q are (n + «)-th roots of unity, the same 
holds for j = n + 1, . . . ,n + k — 1. Again because Ci~ K+1 = C +1 j the last equation 
of (Till) holds as well. □ 



Remark B.2. The system of eigenvectors obtained can be seen as a multiparameter 
generalization of the Fourier basis, to which they reduce for k = 2. 

Appendix C. Symmetric rectangular multiparameter eigenvalue 

PROBLEMS REVISITED 



In section 15.11 above we gave an ad hoc definition of symmetry for a multipa- 
rameter eigenvalue problem in the form (I15|) . While this definition suffices for 
the purposes of the present work, it is conceptually not satisfying and not general 
enough in many relevant cases. In this appendix we discuss a more general and 
formally more convincing definition. 

Let A\, . . . , Af. : V —> W be linear operators between the m dimensional vector 
space V and the (to + k — 2)-dimensional vector space W . A rectangular multipa- 
rameter eigenvalue problem is the equation 

k 

(22) Yl X i A i v = ° 

in complex unknowns (Ai, . . . , A&) ^0 (the multiparameter eigenvalue, defined up 
to a multiplicative constant) and O/dgF (the eigenvector). 

A symmetric rectangular multiparameter eigenvalue problem is a rectangular 
multiparameter eigenvalue problem together with the additional data of k "dual" 
operators B\,...,B). : V — > W* , such that the the bilinear forms 

(u,v) ^ Bi(u) ■ Aj(v) 

are symmetric. 

Let M(u,v) be the k x k matrix with i, j-entry Bi(u) ■ Aj(v). If u is a solution 
to the multiparameter eigenvalue problem for some eigenvalue A, then A is a right 
nullvector of M(u,u). If M(u,u) is of corank 1, this property determines A up to 
scale. 

If u and v are solutions to the multiparameter eigenvalue problem for distinct 
eigenvalues A, A', then both A and A' are right nullvectors of M(u,v). Hence all 
(fc — 1) x (k — 1) minors of M(u,v) vanish. This can be considered as a joint 
orthogonality condition for u {k ^ .v^^ 1 " 1 6 S k V. 
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For each symmetric multiparameter eigenvalue problem one may define a dual 
problem, obtained by exchanging the role of W and W* , and that of the Ai and 
Bi. If u is a solution to the dual multiparameter eigenvalue problem for some 
eigenvalue /i, then /i is a left nullvector of M(u,u). If u, v are solutions to the 
dual multiparameter eigenvalue problem with eigenvalue \i, fi' , then fi, /i' are left 
nullvectors of M{u,v). In particular the joint orthogonality of vS k ~ 1 ^ ,v^ k ~^ with 
respect to the bilinear forms defined by the (k — 1) X (k — 1) minors of M(u,v) 
follows again. 

Example C.l. Consider the Heine- Stieltjes equation (J9J. It is a rectangular multi- 
parameter eigenvalue problem with A i = L — n{n — 1 + X^ ^nj)x k , A-i = x k ~ x ,A3 = 
x k ~ 2 ,--- ,Ak = 1. Here V = V n and W — V n +k~2- The eigenvalue problem is 
symmetric, with the dual operators Bi being defined by the scalar products: 

B t :V^W* 
V M> (w t— > (v, w)i). 

The dual rectangular eigenvalue problem is equation (|16[) . whose solutions (i. e., 
the eigenvectors) form a jointly orthogonal system. 

The results of this paper may be interpreted as saying that under suitable tech- 
nical conditions the solutions (eigenvectors) of a symmetric rectangular eigenvalue 
problem are equal to those of the dual problem. 
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